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ABSTRACT 

The Air Force uses a standardized costing aethodology 
for resident technical training schools (TTS) ; no coaparable 
aethodology exists for coaputing the cost of on-the-job training 
(OJT) . This stu'^y evaluates three alternative survey aethodologies 
and a nuaber of cost aodels for estiaating the cost of OJT for airaen 
training in the Adainistrative Specialty (702X0) froa the 1-level 
(helper) to the 3-level (seai-skilled) . The final costing aethodology 
selected for use in the next phase of this research effort can easily 
be adapted to other Air Force specialties and skill levels. The 
quality of OJT and TTS graduates is coapared according to several 
criteria, and the evidence indicates that neither type of training is 
superior to the other for the Adainistrative Specialty. The cost per 
graduate of OJT for this specialty was estiaated to be significantly 
below the cost of TTS. However, it is iaportant to consider other 
factors in addition to cost prior to drawing any inferences 
concerning the optiaal OJT/TTS aix. The effect of these factors is 
discussed at length in this report. (Author) 
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PREFACE 



ThfS report Is the first of two reports describing the results of a 
contract study entitled "Develc^iMnt t Evaluation, and Application of 
Methodologies for Determining the Cost of Air Force On-the-Job Training," 
Contract Mo- F4l609*72-C-00^*i, conducted by Cooper and Cwrpany, St^ford, 
Connecticut. Mr. Bernard Sorters, Coojrer and Con^any, was the principal 
Investigator and wrote this report. Mr. Uohn N. Taylor, AFHRL/MDS, made 
a rt«jor contribution to the revision of the report- Appendix "Selec- 
tion of an Optimal OJT/TTS Mix," was written by Captain Alan D. Dunham. 
The cooperation of Mr. C- L. NIblock, Mrs. H. M. Scott, and Mr. C. 0. 
Yelverton, Cost and EconcMnlcs Analysis Division, Headquarters ATC; and 
Mrs, Barba*-a Horner, RAND, Is gratefully acknwledged. Dr. Don Meyer *s^ 
ATC/XPT, sponsorship and enthusiastic Interest In this research Is 
sincerely appreciated. 

The work was conducted under Project 2077 • Personnel and Manpower 
Management Systems Development, Task 207703f CofT|>uter-Bdsed Models of 
the Air Force Personnel Subsystem* The research Is a partial response 
to RPR 73*02, Optimal Mix of On^the-Job Training and Technical School - 

Captain Alan D- Dunham served as Contract Monitor for the Laboratory. 
After his reassignment. Major Fred Nordhauser asswned this function. 
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THE DEVELOPMENT OF A METHODOLOGY FOR 
ESTIMATtNG THE COST OF AiR FORCE ON-THE-JOB TRAINING 



i INTRODUCTION 

In FY 1573* the Air Force trained some 80,000 non-prior 
service airmen. At the completion of training, these I-Ievel (helper) 
airmen attained the 3~lave1 (semi -sk! 1 led) status. The majority of 
these airmen were trained In Air Training Cormiand (ATC) resident 
technical training schools (TTS) ; however, the predominant nwthod of 
training within the Air Force Is on-the-job training (OUT). Upgrade 
training (UGT) to the 5-level and the 7-level Is almost exclusively via 
formal OJT. The Cost and Economic Analysis Division, DCS/Con^trol ler, 
HQ USAF has develc^d and maintains a Cost Factors Swmnary which cer- 
tains current average cost per graduate information for each resident 
technical training course in ATC. No conparabie or similar informa- 
tion is available for on-the-job training courses. 

Cost per trainee Information for OJT would be useful for policy 
decisions affecting the planning and programming of airman training, uti- 
lization and retention. More specifically, OJT cost information could be 
used in the selection of an optimal mix for OJT/TTS training, life cycle 
costing of weapon systems, the selection of Air Force Specialties for 
Variable Reeniistment Bonus and Proficiency Pay, and the evaluation of 
the dollar intact of changes to the OJT course curriculum. 

In an earlier study (Dunham, 1972), a general equation or model 
of cost elements for confuting OJT costs was developed to be comparable 
with Air Force resident TTS costs for Category B Air Force Specialty 
Codes (AFSC).^ 

The Dunham equation for OJT cost is 

Y - + X2 + X 3 + + Xg + Xg 

where: Y = OJT cost per trainee 

X^ n Cost of trainee time spent In training 

« Cost of supervisor time devoted to training 



Category B specialty trainees may upgrade from the l-leve1 to the 3* 
level either by attending TTS or convicting OJT. Category A specialty 
trainees may upgrade via TTS only; while Category C specialty trainees 
may upgrade via OJT o.<ly. 
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X3 ~ Rtfnedial training cost 
Xj, Records management cost 

- Cost of delayed entry tnto training 
Xg : Equipment and material costs 

For purposes of on-the-job training and resident technical 
school training cost con^arisons , the following cost equation to 
adjust resident training costs Is used. 

2 - W, ♦ + w, 
where Z Adjusted resident technical training cost 
Wj Resident technical training cost 
W2 '■ TTS equivalency cost 

- TTS delay cost 

TTS equivalency cost (W^) adjusts resident training cost (Wj) 
for the cost of training the 3-level TTS graduate (trainee cost only) 
to a level of proficiency equivalent to the OJT-tralned 3-level. W3, 
the TTS delay cost adjusts Wj for the cost associated with the TTS 
graduate's delayed entry time Into the tnork force due to such activities 
as personnel processing and familiarization with local procedures. \^ 
\il and W? are estimated is discussed In n»re detail later in this report. 

The purposes of the present investigation vtere (a) to develop 
alternative methodologies for cwnputing estimates of the elements of 
cost X^, X^f X3, Xi^, X5, and Xg, and adjustments Wo* and W3 using 
AFSC 702x0— Administrative Specialty as the experimental case and (b) to 
apply the preferred methodology to five additional AFSC's. This report 
will deal only with the development of the methodologies. The applica- 
tion of the "best" methodology to other AFSC's will be presented in a 
second report, entitled "The Evaluation and Application of a Methodology 
for Estimating the Cost of Air Force On-the-Job Training." 



As alluded to above, Dunham published the results of a study, 
(Dunham, 1972) designed to estimate the cost of OJT. He Investigated 
the Conwiunicat ion Center Operations Specialty, Air Force Specialty Code 
(AFSC) 291x0, in that study with the following results: The study 
provided empirical evidence which strongly supported two hypotheses, 
namely, that it was possible to obtain "realistic and useful" estimates 
of OJT costs using survey research techniques and second that there may 
be large differences between OJT and TTS costs, indicating that it would 
be worthwhile to continue collecting OJT cost data for other specialties. 
(Appendix 7 discusses the criteria to be considered in addition to cost 
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In determining an optinMl OJT/TTS mix). 

In his study, Dunham used a mail survey technique to obtain 
information for estimating the cost elements and adjustment factors. 
His technique required respondents to make their best judgnwnts about 
aggregate past experience (e.g., how long does it usually take, In 
your experience, to con^lete training to the 3~level for an Adminis- 
trative Specialist?). This technique a%ke6 the respondent to recall 
experiences that may have occurred imnths and even years earlier and 
then to "integrate" them into an average estimate. The results were 
promising although the variances of the estimates were quite high. 
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II DESCRIPTION OF STUDY 



A. Identification of Survey Methodologies 

To attenq>t to Inprove on the methodology used in the Dunham 
study, two primary alternative approaches were considered. The first* 
which might be called a Work Sampling Approach , asked the respondent 
to answer questions about the training he did last week for specific 
individuals. Note that this still called for some recall (over a 
much shorter time horizon), but did not require any "integration" of 
experience. 

The second alternative might be called a Self-Recording Approach . 
The respondent was asked to record his actual training experiences for a 
week, which largely eliminates the problem of recall. 

In addition to these alternatives, tw> modifications of the 
original Dunham methodology v^re also used. The first of these was 
not methodologically different in the strictest sense. Rather than 
asking for aggregate experience on how long training might take and how 
much time might be spent at it, the respondent was asked to describe the 
trend in the effort over tin«. In addition to providing an additional 
piece of information (the differential effort In training over tinw), 
the survey provided alternative estimates of the duration and intensity 
of training. 

The second was a n»jor modification of the original Dunham 
technique. It requires asking the respondent *■ ^ ^efer to his o^^n 
training records (AF Form 623 ' Consolidated 7-aining Record) for data 
on the duration of training and to co^)' ihat data out of his records. 

While in the original formulation of the study It was assumed 
that the three methodologies would be kept distinct with three separate 
questionnaires for each, it soon becanw apparent that it was more 
appropriate to combine the methodologies In one survey instruirent. This 
will be discussed in more detail in the subsection "Development and 
Administration of the Survey Instrument." 

In summary, three primary methodologies were explored: 
(I) Aggregate Experience Approach - asking respondents about their 
training experience In general; (2) Work Sanyling Approach - asking 
respondents about their training activity last week, and (3) Self- 
Recording Approach - asking respondents to record their training activity 
for a week. In addition, respondents were asked to make their best 
estimates from their general experience about trends In training effort, 
and to use Information contained in official Air Force training records. 
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B. Identification of Air Force Specialty 

The Air Force Specialty Code studied In this investigation was 
the Category B AFSC 702X0; Administrative Specialist training from the 
1-level (helper) to the 3-level (semi-skilled). The A^imlnistratlve 
Specialist at the 3-Ievei Is what might typically be called a ''clerk- 
typist." His specific duties will vary considerably with the type of 
organization and office he is assigned to. "There Is probably no other 
career field with so many possible combinations of duties as a<fanlnlstra- 
tion."i 

Some of the duties he might be asked to perform are the 
fol lowing: 

"a. Type and control correspondence, n^ssages, publications, 
forms, orders, and Inventories. 

b. Store microfilmed documents. 

c. Dispose of microfilmed documents. 

d. Maintain master publication libraries. 

d- Prepare and process requisitions for publications and forms. 

f. Store and distribute standard, specialized, and recurring 
publications, technical orders, and forms. 

g. Perform mobile distribution system functions. 

h. Operate unit mailrmms. 

I. Operate postal directory service. 

j. Receive visitors, give information, answer phones, and 
other routine office tasks. 



C. Development And Administration Of The Survey Instrument 

It was discovered early In the' invest igat Ion that the nunber 
of airmen sent to OJT as a Direct Duty Assignment (DDA) was considerably 
less than might be expected for the size of the AFSC. At that point 
there was seme concern atH>ut obtaining an adequate sample size for each 



apprentice Administration Specialist , Career Development Course 70230, 
1971. 

2lbid 



of the methodologies* Due to this problem and because there is sane 
advantage from the point of view of direct con^arison In having each 
respondent complete all three n^thodologles, a ccmblned questionnaire 
was adopted, in other words, each questionnaire had 3 parts t each 
corresponding to an alternative methodology and each phrased differently. 
One disadvantage to this approach Is that the questionnaire beccmes 
lengthy and there may be some tendency to do only a perfunctory job on 
the last part. In an effort to reduce this effect, most of the straight- 
forward Informational questions were astced only once« Certain questions 
were repeated as a chectc on rel lability* but these were always asked 
In an alternate fran^vrark corresponding to the ne^ irattodology. The 
three distinct parts of the questionnaire were preserved, and several 
new questions were Included In the first part which otherwise was 
primarily the original Dunham methodology adapted to AFSC 702X0. 

initial Interv ews were held at three Air Force Bases In the 
ban Antonio area: Lackland, Brooks and Kelly. A number of modifications 
were made to the phrasing and format of the questionnaire as a result 
of Information gained at these Interviews. Prirmrlly, the direction was 
toward sinpl i f Icat ion and the reduction of ambiguities. Several trial 
Iterations were made until the questionnaire shown in APPENDIX 5 was 
developed. 

Based on information obtained during the Initial Interviews, 
It was decided to mall the questionnaires to Central Base Personnel 
Offices (CBPOs) and to have Base OJT Monitors distribute them to 
supervisors of OJT trainees. Since the survey was exploratory and of 
relatively small size, the sanpling prc^edure was designed to survey a 
wide range of bases in different c^rmands. Information on the number of 
ODAs In AFSC 702X0 training to the 3*level by base and major air c^ -nmand 
was obtained from the Personnel Processing Group (Lackland AFB) 
cc^uter tape flies. APPENDIX I, Survey Mailing by Base and Cc^VBi»nd, 
indicates the bases selected, the responsible ccmmands, the ntmber of 
DDAs at the base, number of surveys sent and the tabulation of the sur- 
veys returned. Follow-up procedures were used In an effort to Increase 
the number and percent of returns. 
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i i i RESULTS 

A. Survey Response 

295 questionnaires were sent to the field. 207 were returned 
(see APPENDIX I); 199 were usable. The 199 usable surveys provided 
Information on 270 trainees, but In some cases the responses to specific 
questions were either missing or air^lguous. A sunwnary of responses to 
the survey questions Is presented In APPENDIX 2. The survey Instrianent 
is shown In APPENDIX 5- 

All responses were manually edited and reviewed before they 
were coded and keypunched for data processing. This edit and review 
led to a number of detailed c«nnwnts and reccMmwndatlons for question 
and survey Improvements. These conwients and reconmendatlons are pro- 
vided In APPENDIX 3- 

There are several more general c«iments which nwrit discussion 
at this point. First, It was suspected at the outset that the Instru- 
ment was too long, and this was conflmted by a general falling off of 
question responses t<^ard the end of the questionnaire. (This could 
also have been correlated to special difficulties associated with'the 
methodologies utilized In the latter parts of the questionnaire.) 

Second, Initial Information on name, base, etc., was f'equested 
using a free format (I.e., fill In lines rather than enter In boxes). 
Much nwre uniformity could have been obtained frwn a more structured' 
format. 

Third, In an effort to reduce data processing volume, the 
number of spaces allowed for an answer to several of the survey 
questions was kept to a single digit on the assimq>tlon this was suf« 
ficient for the answer. In several cases It was not. These Items are 
discussed Individually in APPENDIX 3- 

Finally, It Is clear that despite several pre-tests and reflne- 
irents, some questions were ambiguous, reinforcing the need for more 
explanation in the questions and more careful instructions In future 
studies. 

B. Comparison of Methodologies 

As discussed earlier In this report, three alternative 
methodologies were evaluated, viz., the Aggregate Experience Approach, 
where each respondent was asked about his training experience. In 
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general; the Vtork Sapling Approach, where each respondent was asked 
about his training activity last v^ek; and the Self -Recording Approach, 
where each respondent v^s asked to record his training activity for a 
week. For each methodology, a set of cost equations or models were 
developed to provide estimates of the cost el^i^nts. (^estionsl through 
17 in APPENDIX 5f Survey instriment, relate to the Aggregate Experience 
Approach; questions 18 through 28 relate to the Work Sa'npHng Approach; 
and questions 29 through 33 relate to the Self -Recording Approach. Since 
some of the questions were asked in a slightly different way under two 
or sometimes three methodologies, clearly, one or tv^ of them iray be 
eliminated in future studies. Also, son^ questions were asked as an 
exploratory probe to confirm or reject some related hypotheses. These 
quest ic^s, as well, may be eliminated in future studies. 

Estimates of cost elements In terms of n^ans and standard 
deviations by methodological approach are provided In Table I, Cost 
Estimating Relationships (ftodels). The nmans and standard deviations were 

cofTH>uted using the cost nKHlels presented in APPENDIX There v^ere 
several cost elements' that were estimated in more than one way within 
two given methodologies (the more important cost elements) and several 
which were estimated only once for alt methodologies (the least 
important cost elements). 

There are no simple criteria for evaluating the different 
methodologies. The *Xost of OJV^ Is not an observable, ft Is a concept » 
and therefore a standard of comparison nt'^cds to be defined. Cost per 
observation, variance, efficiency, per cent resfK>nses, number of errors, 
are all possible explicit criteria. In the final analysis, a subjective 
Judgment and the coefficient of variation (I.e., the ratio of the 
standard deviation to the mean) were used to assess the validity and 
bias of the responses to the specific questions. A brief discusssion 
of each of the cost models used in the development of Table 1 is 
presented In APPENDIX 6. The discussion in APPENDIX 6 indicates the 
underlying rationale for the final selection of the nK>dels for estlmat^ 
Ing the cost elements. Table 2 presents the final model selection and 
an estimate of each of the cost elements and the percent of the total 
OJT cost. 

Tables I, 2 and APPENDIX 2 display the basic nunerlcal results 
of the study. In terms of numerical results the foll^^ing are the most 
significant highlights and conclusions for the AFSC 702X0, Administrative 
Specialty analysis. 

a it takes about 18 weeks on the average to ccmplete the OJT 
training. 

• A trainee spends an average of ten hours per week training 
(and about 25 'n productive work). 
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TABLE I: COST ESTtMATiNG RELATIONSHIPS (MODELS)^ 



MODEL MEAN $ STD DEV $ N 



Aggregate Experience Approach 

1 Trainee Time 610.2^1 I89 

2 Trainee Time 99^.61 646.58 56 

3 Trainee Time 700.14 528.97 165 
k instructor Time 262.38 407.28 I36 

5 Records Ngt Time 103.27 210.26 128 

6 Delayed Entry Time 196.05 166.17 197 

7 Remedial Training Time 40.03 53.62 72 

8 TTS Equlv Time 80. 10 8O.6O 47 

9 TTS Delay 201.28 166.77 167 



Work Sampling Approach 



i1 


Time to Proficiency (Non-Cost) 


24.41 


24.26 


169 


12 


Trainee Time 


744.60 


1397.56 


167 


13 


Instructor Time 


965.58 


1801.37 


157 


14 


Delayed Entry Time 


208.95 


226.60 


165 


15 


Record Ngt Time 


137.70 


215.05 


5t 


16 


TTS Delay Time 


160.01 


183.32 


74 


17 


TTS Equlv Time 


201. 16 


744.68 


62 



Self -Recording Approach 

21 Trainee Time 409-78 415-08 163 

22 Productive Time 821.46 599-82 163 

23 Instructor Time 591-35 576-77 55 

24 Trainee Time 570.18 449-70 55 



hn addition to these models two other estimates of cost elements were 
used. One is the cost of Tech School which Is discussed In subsection 
C. The other is the cost of Equlf»nent and Materials. The variable cost 
of producing and administering CDC Manuals, the only significant 
equipment and material Item, was estimated to be $10.18 by Headquarters 
Air University/ECi. 
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TABLE 2: SUMMARY OF OJT COST ELEMENTS 



£ lament Model Cost % 

Trainee Time (Xj) 24 570.18 36.9 

Instructor Time (X2) 23 591.35 38.3 

Delayed Entry Time {X5) 6 196.05 12-7 

Records Management Time (Xj^) I5 137-70 8.9 

Remedial Training Time (X3) 7 ^0.03 2.6 

Equipment & Material^ (Xg) - 10.18 .6 



TTS fl«T>ents 



15^5.^9 100.0 



TTS Equivalency (W2) 8 . 8O.IO 

TTS Delay (W3) 9 201.28 

Total 281.38 



1 



See Footnote to Table 1. 
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• The amount of trainee time spent In training Is about 25 
hours per week Initially, but trails off over the training 
period. 

• An Instructor spends an average of nine hours per trainee per 
week. 

• Remedial training and record keeping have relatively small 
costs. 

• On the average, the TTS graduate has only about 1/3 the 
proficiency of an OJT trained airman when he starts, but It 
only takes him about k 1/2 weeks to make up the difference. 

• The cost per trainee of upgrading by OJT to AFSC 70230 Is 
about $1500. 

In terms of methodology the following are the most significant 
highlights and conclusions: 

• Asking r-'spondent to make estimates of time and duration based 
on an Integration of their experience yields high variance, 
biased estimates. 

• A journal recording procedure asking specific questions about 
the time spent during a given week, can yield reasonably good 
Information about "time spent per week" providing the sample 
Is large enough. 

• Information on the duration of training can most properly be 
derived from historical records, either the AF Form 623 or the 
Uniform Airman Record. 

• A much smaller, easier to complete Instrument can be developed 
which Is AFSC Independent. 

• A combination of methodological approaches will probably yield 
the best Phase M questionnaire. 

• Dunham's technique (the original methodology) asking for 
average historical experience. Is useful for certain of the 
smaller cost elements. Major cost elements can be developed 
with greater accuracy from journal recording and already 
existing data. 
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C. TTS Costs 

In the Dunham study, TTS costs were derived from estimates 
developed by RAND Corporation (Allison, 1971) based on a generalized 
costing methodology which included total recurring costs (both fixed 
and variable.}^ RAND estimates v^re also obtained in May 1973 for the 
70230 specialty. These estimates yield a cost of $lkBO per trainee on 
an average cost basis. Eliminating the fixed costs to maice the costs 
more con^arable to the OJT cost estimates, the cost per trainee would 
be $2000. In addition to the $2J00, It Is appropriate to add the 
results of Models 8 and 9t TTS Equivalency Time and TTS Delayed Entry 
into Training (see Table 2). The net effect of these two adjustments 
would be to add $281, for a total of $228l per trainee. 



D. Quality of. OJT and TTS Graduates 

In addition to cos^aring the costs of training, the quality of 
OJT and TTS graduates was also coiT^ared In terms of performance as 
perceived by supervisors. Responses to questions 11.3 and 11.4 (I.e., 
11c and lid) Indicate that 5^1 of the supervisors perceived a difference 
between the performance of OJT and TTS graduates after achieving the 
S'level. Of the 87 supervisors responding to question lid, 51 (or 59%) 
considered TTS graduates superior; while 36 (or considered OJT 

graduates superior. H<»yever, 75 supervisors (question 11c) Indicated 
neither was superior. Thus there Is Insufficient evidence to support 
the hypothesis that TTS graduates are superior In terms of performance 
to OJT graduates as perceived by supervisors. This conclusion is in 
accord with Dunham's study of the Communications Center Operations 
Specialty, in that study, he analyzed the Specialty Knowledge Test (SKT) 
scores for TTS and OJT trainees and found essentially no differences for 
the two types of trainees, in another AFHRL investigation (Lecznar, 1972), 
the performance of OJT and TTS trainees was compared In terms of six 
criteria: a Job difficulty Index, average task difficulty, number of 
tasks performed, job Interest, self-report of utilization of talent and 
training, and overall performance ratings. Again, no advantage of TTS over 
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OJT training was found. Perhaps, the nK>st thorough investigation of 
this topic was reported by Dunham at the 1973 Military Testing Associ- 
ation Meetings (Ounhain, \S7'i) • In that study, OJT and TTS graduates 
were again conpared in terms of SKT scores, however, the trainee's race, 
AQE scores and SKT version were held constant. Using an analysis of 
covariance, it was again concluded that for six Category B AFSCs 
(including AFSC 70230) OJT and TTS graduates were of esual quality. 
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IV DISCUSSION OF RESULTS 

A' Advantages And Disadvantages Of Each Methodology 

Each of the three survey approaches or methodologies used 
has a number of advantages and disadvantages relative to each other 
as well as relative to other alternative methodologies. A time and 
motion analysis such as might be conducted under the USAF Management 
Engineering Program (see AF Manual 25-5) was not used because of the 
exploratory nature of OJT costing studies and the requirement to commit 
a larger amount of dollar and manpower resources. An Interview technique 
was evaluated by Dunham In a previous study and the advantages of the 
Interview approach versus the survey approach were discussed In that 
report (Dunham, 1972). 

The Aggregate Experience Approach (based on Supervisor's total 
OJT experience) has the relative advantages of (1) a larger sample 
availability at any one time and (2) con^letlon at one sitting. The 
disadvantages Include (I) a larger empirical variation in responses and 
(2) Air Force Specialty dependence which requires different survey 
forms for each specialty, multiple computer program formats for analysis 
and maintenance of OJT cost data, and makes the aggregation and com- 
parison of OJT cost across specialties more difficult. 

The advantages of the Work Sampling Approach are that (1) the 
survey Instrument can be completed In one sitting, (2) It Is specialty 
Independent, (3) the recall required Is for more recent experience (1 
week) and (k) the response variance Is less than for the Aggregate 
Experience Approach. The disadvantage Is that a larger san^le size is 
required in order to ensure the presence of an OJT trainee during the 
previous week. 

Advantages associated with the Self -Recording Approach are 
(I) It is specialty Independent. (2) the recall Involved is limited to 
one day and (3) it has generally reduced response variance as compared 
to other survey approaches. The disadvantages of the Self -Recording 
Approach are (I) It requires a larger initial senile, since a currcnt]y 
enrolled OJT trainee is required and (2) the turn around tln^ Is longer, 
and this may result In a smaller usable sample due to the Increased 
time the questionnaire Is in the field. 

Thus, the selection of a survey approach involves a number of 
trade-offs. The study supported the possibility of obtaining reasonable 
estimates of time spent by trainees and instructors through the Self- 
Reporting Approach and this is perhaps the superior of the three 
methodologies, depending the least on recall. The one advantage to 
asking for recall rather than future recording Is t imel innss. Recall can be 
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accomplished immediately as the questionnaire \^ completed. ^'Journal 
Recording*' requires time and, tHercfore. Jeopardizes return of the 
questionnaire- Given the hich level of responses^ this did not seem 

Though not reaHy a part of any of the methodologies* 
Dreviou^ly recorded data 5*- often the best and cheapest source of 
information, particularly if it has been authenticated for other 
purposes • The ubc of recorded data on Date of Entry Into Training and 
Date of Av'.ard of AFSC v/as included in the first section of the survey 
a*- an extension of the existing methodology. This is an in^ortant way 
of developing the data; although it may be easier to get this inforr^a^ 
tlon fror the Uniform Airman Record File, rather than asking the 
'nui^erv ! sors to copy <t out of the AF Form 623 • 

The original Dunham mt^thodology is desirable for sampling 
rt:'li!ive1v infreauent ohenumenD. ^since any ^'current'* sanpling scheme 
u>lMq 'ournal recording would have to involve very large samples. On 
the other hand, for sampling ongoing major work activities, the 
journal recording scheme seer«> a desirable alternative fwthodology. 

In summary, both the earlier methodology and "journal 
recording'* have potential for eliciting cost data. The applicability 
of a soeciflc methodology depends on the specific data item in question. 

3 . PelaiTonshlp of QJT Costs to TTS Costs 

We have sho\';n that for AFSC 702X0, the Admlni st r<i*^ i ve Specialty, 
OJT cos^'- '.ere 515^5 and TTS cost^ were $2281. This is a ^ubstant"»al 
difference which is con^ist#r^nt with results obtained by Dunham (H72}. 
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V CONCLUSIONS 



A. Significance Of Results 

The most significant result of the present study (Phase t) Is 
that it advances the mall survey technique as an effective method for 
developing estimates of OJT costs. A number of modifications to the 
original Dunh«n approach were developed and applied In Fhase i. Based 
on the results obtained In Phase if It should ncM be possible to 
specify a survey methodology and a smaller, more precise, AFSC Independent 
questionnaire with reasonable pronlse of providing useful OJT cost 
estimates for additional AFSC's (Phase It). 
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APPENDIX 1: SURVEY MAIIING BY BASE AND COMMAND 



BASE NAME 


COMMAND 


#DDA' 


Bol I ing 


HDQ 


1 


Edwards 


AFSC 


5 


Chanute 


ATC 


3 


Hancock 


ADC 


1 


H{ n 


AFLC 


2 


Wright Patterson 


AFLC 


2 


Mather 


ATC 


9 


Mi not 


SAC 


7 


Grand Forks 


SAC/ADC 


9 


Patrick 


AFSC 


6 



j^SURVEYS SENT #SURV£VS RETURNED 



I 

5 

3 

1 

2 

2 

9 

7 

9 

6 



0 
k 
2 
I 

0 
2 
6 
0 
8 
2 



Bergstrom 

Forbes 

Griffis 

Kirtland 

Lang ley 

Norton 

Randolph 

Lowry 

Luke 

McChord 



TAC 

TAC/MAC 

SAC/AFSC 

AFSC 

TAC/AFSC 
MAC 
ATC 
ATC 

TAC/ADC 
MAC/ADC 



n 

13 
12 

19 
16 
12 
12 
12 
17 
15 



10 
10 

to 

10 
10 
10 
10 
10 
10 
10 



8 

6 

7 
10 
k 

9 
6 

9 
8 

10 



Barksdale 

Carswel 1 

Cast le 

Charleston 

Dover 

Egl in 

El Isworth 

Lackland 

Travis 

Maxwe 1 1 



SAC 


^9 


15 


SAC 


32 


15 


SAC 


25 


15 


MAC 


26 


15 


MAC/ADC 


2k 


15 


AFSC/TAC 


27 


15 


SAC 


32 


15 


ATC 


25 


15 


MAC/SAC 


k\ 


15 


AU 


26 


15 



15 
2 

15 
13 
14 
1 

9 

14 

9 

13 



TOTAL 



i*91 



295 



207 
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APPENDIX 2; SUMMARY OF RESPONSES TO QUESTIONS > 







MEAN 




NUnQtn Ur 








DEVIATION 


RESPONSES 


I'. 


Persons In Section 


7.27 


7.46 


196 


2. 


Days Delay in Start - 3 


8.60 


7.29 


197 


3. 


Days Delay In Start - 5 


8.44 


7.00 


167 




Weeks To 3 Level Proficiency 


13.30 


7.00 


178 


5. 


Weeks - Proficiency To Award 


3.31 


2.61 


158 


6.1 


Number of 3~ Level Trainees 


1.34 


0.84 


198 


6.2 


Number of 5" Level Trainees 


1.06 


1.45 


197 


7. 


More Trainees Possible 


1:11 


1.23 


197 


8. 


More Trainees Without 5*s 


0.77 


1.02 


184 


9. 1 


Operate With Less Personnel'* 




U . U J 




9.2 


Number Fewer 


1. 14 


1. 16 


79 


10. 


Are 3's Proluctlve'* 


0.82 


0.03 


191 


11.1 


Pet of 3 Skill On Arrival (Grads) 


31.79 


23.76 


172 


11.2 


Additional Weeks To 3 Level 


4.48 


2.35 


166 


11.3 


Difference tn TraininQ** 


0 ^4 


0 04 


1 A4 


11.4 


OJT Super lor"* 


0.41 


0.05 


87 


12.1 


Pet Failing (AXT) 


25.64 


24.75 


108 


12.2 


Weeks Remedial Training 


3.60 


1.81 


105 


12.3 


Trainee Remedial Hours 


9.07 


7.20 


107 


12.4 


Instructor R^edial Hours 


5.28 


3.41 


106 


13. 


Record Keeping Hours 


1.94 


3.42 


189 


14. 


Nurt^ber of E3 Instructors 


1.39 


0.85 


18 




Nu^iber of Lk Instructors 


1.28 


0.64 


60 




Number of E5 Instructors 


1.20 


0.57 


89 




Number of E6 Instructors 


1.09 


0.51 


35 




Number of E7 Instructors 


1.00 


0.0 


12 




Average Grade Of instructors 


4.82 


0.79 


141 



^Note that question oarts a, b, c, etc., are coded .1, .2, .3, etc. 

^This ;s "S," an unbiased estimate of the Universe Standard Deviation, 
derived from the sample. A confidence limit on the sample mean would be 
derived fran the standard error of the mean, S//n~. 

•^Thls Is the number of valid responses, (e.g., blanks or unreadable 
responses have not been counted). 

'♦Questions 9- 1 # 10., 11.3 and 11.4 have dichotonious answers with the 

results expressed as pr opor t ions. Thus the mean Is a fraction and the 

standard deviation is /pq/n which Is the standard error of the binomial 

dlstf ibut ion. The response to Question 10. should be interpreted "821 
responded yes." 
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APPENDIX 2 (Cont.) 



15. Skill 



IS'l Career 

15-2 Security 

15.3 Supervision 

15*4 Equipment 

15.5 Publications 

15.6 Forms 

15.7 Connuni cat ions 

15.8 Documentation 

15.9 library 
15.0 Postal 



EXPERIENCE 



Pet 


Std Dev 


N 


0.99 


0.01 


178 


0.97 


0.02 


131 


0.97 


0.02 


76 


0.99 


0.01 


186 


0.99 


0.01 


156 


0.98 


0.01 


122 


0.98 


0.01 


135 


0.98 


0.01 


124 


0.71' 


0.08 


35 


0.76 


0.06 





WEEKS TO PROFiCiENCY 

Mean Std Dev N 

2.86 4.21 170 

2.05 2.41 129 

4.80 7.44 71 

3.78 3.92 180 

4.51 *.07 150 

3.64 3.56 117 

4.99 5.08 130 

5.02 5.03 118 

2.70 3.53 30 

3.10 3.72 h2 



15.1 Career 

15.2 Security 
15'3 Supervision 
15*4 Equipment 

15.5 Publications 

15.6 Forms 

15.7 Cwmuni cat ions 

15.8 Documentation 

15.9 Library 
15.0 Postal 



INSTRUCTOR HRS/WEEK 

Mean Std Dev N 

2.9^ 3.98 174 

1.78 1.38 129 

3.22 5.05 73 

3.31 4.48 182 

3.59 5.70 151 

2.65 ^.23 117 

3.27 ^.^^ 132 

3.04 4.32 121 

1.16 0.73 31 

2.07 2.74 44 



TRAINEES/ INSTRUCTOR 

Mean Std Dev N 

1.67 1.00 177 
1.73 1.13 132 

1.68 1.01 78 

1.69 1.09 182 
1.66 0.96 154 
1.64 1.03 121 
1.79 1-18 135 
4.81 1.17 124 
1.53 1.18 36 
1.73 1.^0 51 



15.1 Career 

15.2 Security 

15.3 Supervision 

15.4 Equipiiient 

15.5 Publications 
15-6 Forms 

15.7 Conmuni cat ions 

15.8 Documentation 

15.9 Library 
IS.O Postal 



TRAINEE 


HRS READING 


Hean 


Std Dev 


N 


2.48 


2.62 


177 


1.83 


2.16 


131 


2.87 


4.86 


75 


2.09 


2.25 


180 


2.99 


^.53 


156 


2.07 


2.09 


120 


2.64 


2.55 


135 


2.52 


2.55 


124 


1.71 


1.41 


35 


2.04 


1.46 


48 



TRAINEE HRS OJT 




Mean 


Std Dev 


N 


5.30 


8.11 


174 


2.06 


2.12 


127 


4.03 


5.46 


72 


7.05 


8.47 


182 


4.84 


6.25 


153 


3.36 


4.83 


116 


5.64 


7.23 


132 


4.40 


6.34 


121 


2.31 


4.61 


29 


3.00 


4.37 


A3 
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16. 

Week 

I 
k 
8 

12 
16 

20 



17. 



AQE MECH 
AQE ADM IN 
AQE GEN 
AQE ELEC 
ED LEVEL 
AFSC-Entry 
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APPENDIX 2 (Cont.) 



TRAINEE MRS PRODUCTIVE 





9 to uev 


N 


1 1 fl7 


O.oO 


lo2 


1 7 OO 


0.33 


loO 


23.44 


8.03 


150 


27.25 


7.74 


136 


30.78 


7.41 


116 


33.21 


8.67 


105 




OJT 




Mean 


Std Dev 


N 


44.34 


23.70 


301 


63.62 


15.54 


300 


59.63 


18.95 


300 


54.07 


19.67 


300 


12.33 


1.10 


318 


160.03 


74.89 


105 




22 




f . 


31 





TRAINEE HRS INSTRUCTION 





Std Dev 


N 


27.54 


9.45 


162 


21.95 


8.44 


160 


iO. DO 


7.90 


149 


12.89 


7.60 


135 


9.43 


7.37 




6.95 


8.72 


104 




TECH SCHOOL 




Mean 


Std Dev 


N 


37.97 


20. 19 


72 


58.96 


14.75 


72 


52.22 


17.22 


72 


48.88 


17.40 


72 


12. 18 


0.91 


78 


86.69 


69.45 


36 




APPfNOl X 7 (Cont . ) 



QUESTION 

18. Week Of Training 

19. Pet Training Conpleted 

20. Pet of 3 Ski n On Arrival 

21. Days Delay In Start - 3 



22. Trainee Hours 

23. Instructor Hours 
Instructor Hours/Trainee 

2^. Record Keeping Hours 

Record Keeping Hours/Trainee 



25. Number of E3 Instructors 
Nunbcr of Instructors 
Number of E5 Instructors 
Number of E6 Instructors 
Number of E7 Instructors 
Average Grade Of Instructor 



26. Days Delay In Start - 5 

27. Pet Of 3 Skill On Arrival - 5 

28. Additioml Wks To 3 Level - 5 



30. Number Of Trainees 

31. Trainee Hrs Instruction 

32. Trainee Hrs Productive 



33. Instructor Hrs E3 
Instructor Hrs E^ 
Instructor Hrs £5 
Instructor Hrs £6 
Instructor Hrs E7 
Average Instructor Hrs/TraJnee 
Average Grade Of Instructor 



MEAN STD OEV N 

10.88 8.27 176 

56.21 28.42 176 

10.93 1^.30 176 

Q.16 9.9^ '65 



9.07 7-82 180 

10.88 10.71 »78 

7.91 7.'»8 171 

1.88 2.86 178 

1.36 1.60 171 



1.17 0.58 23 

1.12 0.39 50 

1.11 0.i»6 91 

1.10 0.63 ^8 

1.03 0.33 29 

5.03 0.92 129 



6.71 7.69 7^ 

29.57 22.81 82 

5.05 4.88 76 



1.30 0.71 186 

10.61 6.72 173 

24.73 17.85 172 



9.15 7.17 20 

10.90 9.70 

8.00 5.27 81 

8,05 6.57 'fl 

6.78 5.16 23 

8.80 6.69 158 

5.05 0.98 159 



ERIC 



23 

32 



APPENDIX 3: DETAILED COMMENTS AND RECC^ENOATIONS ON 

QUESTIONS AND RESULTS 



APPENDIX 3: DETAILED COMMENTS AND RECOMMENDATIONS ON QUESTIONS AND RESULTS 



1. PERSONS IN SECTION 

2. DAYS DELAY IN START - 3 

3. DAYS DELAY IN START - 5 
k. WEEKS TO 3 LEVEL PROF 

5. WEEKS - PROF TO AWARD 



These answers are slightly more 
efficient than 21 & 26 



Serious under-estIfl»te-''questlon5 
16, 17. 7t 18 s 19 suggest 20 
weeks, not 13 «^ks, is a better 
estimate— delete 

Slight truncation in editini^ 
because of only one space In 
questionnaire; convert to two 
on next survey 



6. 1 NO. 3-LEVEL TRAINEES 

6.2 NO. 5-LEVEL TRAINEES 

7. MORE TRAINEES POSSIBLE 

8. MORE TRAINEES WITHOUT 5'S 

9.1 OPERATE WITH LESS PERSNL - PCT 

9.2 NO FEWER 

10. ARE 3'S PRODUCTIVE 



11.1 PCT OF 3 SKILL ON ARVL - 
TECH SCHOOL GRADS 



Checks well with 23 & 30 

Only useful for general 
information — delete 

Indicate some slack in 
instructor time — questions are 
awkward 



indicates trainees are contri- 
buting to productivity 



Corroborates questions 16, 22, 31 
& 32— question 7 through 10 are 
not used in cost models, but are 
interesting for general Informa- 
ticMi purposes — they stould be 
revised and cc»nbined 

Very similar to, but n»re response 
than 27--perhaps because at end 
of survey, perhaps because of 
"last week" 
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APPENDIX 3 (Cont.) 



11.2 ADDITIONAL WKS TO 3 LEVEL 



113 DIFFERENCE IN TRNG - PCT 

\Kk OJT SUPERIOR - PCT 

12.1 PCT FAILING ECT 

12.2 WKS REMEDIAL TRAINING 

12.3 TRAlNcL REMEDIAL HRS 

12. ^ INSTRUCTOR REMEDIAL HRS 

13. RECORD KEEPING HOURS 



AVERAGE GRADE OF INST 
15- SKILLS 



Significantly smaller with 
smaller variance than 28« 
althouqh answer was slightly 
truncated in editing because 
of 1 box'-convert to two on 
next survey 

Yields little definitive infor- 
mation, other than quality of 
training may be random-^delete-- 
responses to question I! ccmpare 
well with Dunham study 

Even with high estimate in 12.1 
remedial training model shows 
dollar amount to be very small — 
12.2 should have 3 spaces 



Question 2^ has smaller variance-- 
both extremely smal l--subject 
to considerable round off errors 
In editing 9 because a single 
space was provided^ -a I so so small 
that validity of estimates are 
subject to doubt — delete 

Poorly phrased (as connected with 
8) --33 gives the most response 
and weights more accurately-- 
delete 

High variance to mean ratio** 
probably too many categories 
and no total time reference-- 
information on skills Is 
Interesting but question is AFSC* 
de|«ndent» which Is undesirable 
in the long run 
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APPENDIX 3 (Cent.) 



16. TRAINEE HRS PRODUCTION 
TRAINEE HRS INSTRUCTION 



17. TRAINEE AQE, ED LEVEL 
AND TRAINING HISTORY 



18. WEEK OF TRAINING 



19. PCT OF TRAINING COMPLETED 



20. PCT OF 3-SKILL ON ARRIVAL 

21. DAYS OEUY IN START - 3 

27 
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Important and informative 
question — see coments on 
questlcm li— shows trend clearly 
alttough absolute values 
probably overstated-*see 22 » 30 
S 3 1** If used again revise 
Instruct Icm to ask for an wtry 
In every v^k shown » so that 
for later weeks an aswer tike 
40, production* 0« Instruction 
Is given more weight 

Correlatlms show nothing t although 
a slight tendency to send higher 
AQE Admin to OJT agrees here with 
EHinham work— '*AFSC-Entry to Award** 
yields useful data--but response 
Is not high, and it may be 
subject to "copying** errors- 
development of AFSC entry to 
av^rd from Uniform Al rnwn Record 
would be very useful 

This Is probably the most potent 
way of determining length of 
training (the m^n Is the mid* 
range of a uniform distribution 
of length In train I ng)-'Muper visor 
is asked to recall a nimber he 
can figure out— It Is not an 
* 'average experience guess** but he 
usually doesn*t have to look It 
up and can probably give It 
quite accurately 

t^ile this is a guess » the mean 
suggests Its not too bad on the 
average and corroborates 18 — 
question would have been better 
If relationship to 20 was 
spel led out 

Helps to confirm notions of 
productivity In 16 and 32 by 
demonstrating capability — 

See comments on 2--delete 
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22. 

23. 

2t». 
25. 



APPENDIX 3 



(Cent.) 



26. 
27. 



28. 
29. 
30. 
31. 

32. 
33. 



TRAINEE HOURS 



INSTRUCTOR HOl^S 



RECORD KEEPING HOURS 
AVERAGE GRADE OF INSTRUCTORS 



Very similar, slightly less 
efficient then 31"de1ete 

Compares well with 33 but 33 
also yields grade"- delete 

See comments on 13-''delete 

See conments on l'i--33 Is 
probably best quest lon--delete 



Note: Quest icms l8 thrmjgh 25 provide very little 
information by having 3 columns, (3 trainees). 
They confuse respondent and n»ke prMessing 
difficult. Relatively few surveys provided 
inforiMtion on second or third trainee. A 
nK>re appropriate way to handle the problem 
might be to ask the respondent to preside 
.information on the trainee vA^ Is most nearly 
average, when he has n»re than one, or to 
simply sm over all trainees as was <tone in Part C. 



DAYS DELAY IN START - 5 
PCT OF 3-SKILL ON ARRIVAL 5 



ADDITIONAL WKS TO 3-LEVEL 5 
DATE STARTED RECORD KEEPING 
NUHBER OF TRAINEES 
TRAINEE HRS INSTRUCTIONS 

TRAINEE HRS PRODUCTIVE 

AVERAGE GRADE OF INSTRUCTOR 



26 through 28 should not be 
asked of instructors selected 
on the basis of training 3's*" 
asking about last week leads 
to lower response and higher 
variance—should be asked in 
general as In questions 3f 
11.1 and 11.2--delete 



Not necessary-'delete 
See 6.1 -'delete 

See 22 "Best" Method of Estimating 
Time 

Important as a contrast to 31 
(See 16) 

See comnents on 14, 23* 25 
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COST MODELS - PART A 

TRAINEE It ME I 

n skills 

Trainee wage/hr [ weeks for skill I (trainee hrs. for skill I/week) 

l«l 

n"IO 

TTI - WE2 5; 15.1.2.(15.1.3. + 15. 1. A.) 
!-l 



TRAINEE TIME 2 

fh trainees 1 
Tra I nee wages/day 1^ date of AFSC - date of entry - wks from prof cncy to aM^rd (7)| 5 

U-l # of trainef . J 7 * 

n trainees 



7 (non prod hrs) 
(>of trns) 



1-1 

TT2 - WE2 



I (17. 1.8. - 17.1.7.117.1.9 - l)/n - (7)5. 5 V 16.1.2. 
.i»l 17 i . AO n 



i-l 

TRAINEE TIME 3 

n tr 

(t ime to prof Iciencv in weeks) r . 

'♦O (# of traineesT 



n trainees 

Trainee wage/week (t ime to prof iciency in weeks) j rwn pr<Niuctive hr s 

n^6 i-l 

TT3 - WE2(40)(A.) y 16. 1.2. 

• i.0 n 
i-1 



INSTRUCTOR TIME k 

n instructors n skills 

r wages for Instructor i./hr. J weeks for ski 1 1 i (inst. hrs for skMl I) 

i n Instructors 1-1 

i««l 

(Instructors/trainee for skill i) 



n'7 

m - f lA.I. (WEI.) 



n<7 1 -I n-10 -1 
[ lA.i.j I 15.1.2. (15. 1.5){15. 1.6.) 



1-3 U-3 J i-l 



"Note: The conditional {I7'i.9 " ') 'S the code for art OJT trainee. 
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COST MODELS PART A (Cont.) 



RECORDS MANAGEMENT TtME 5 



n instructors 

wages for instructor i/hr 1 nst ructor record kpng hrs/wk (wks to proficiency) 



1 nsiructors 



( = 1 

n-7 

RM5 = ' U. i . {WE 1 . ) 

;'3 



n<l 1-1 

l^^.i.^ (13. ){^.) 

Li"3 



DELAYED ENTRY TIME 6 

Trainee waqes/day (time vaiting to bepin 3 level training) 
DE6 » WE2 (8) (2.) 



REMEDIAL TRAINING TIME 7 
Fn instructors 

j wages for instructor i./hr (weeks remedial tra in ing) (hrs/wk instructor time) 
n I nst ructor 

-»■ tr.iHcc waqe/hr (weeks remedial training) (hrs/wk trnee time) 
( ^lilinq cnH of course test) 



n7 rn-7 1-1 , 

RT7 . ,V li*.;.(WEi.)') U.i.; (12.b.)(12.d.) + (WE2)(12.b.)(12.c.)i (12^ 



\ 



i-3 



J-3 



J 



100 



TECH SCHOOL EQUIVALENCY TIME 8 



1 p 



(Weeks to equival icy) | l - percent capab i 1 i ty . ! trnee time Instructor time 

' 5 ! wks to prof iciency 

r 1 r 

TSE8 - (11. b.) i l - (ll.a./lOO) 1 TT2it IT23 

• 2 : K'^ 



1 



TECH SCHOOL DELAY 9 

(Trainee wage/day) (days delay) 
TSD9 » WE3(8) (3.) 

■Where K « (I7.I.8. - 17- »• 7- ! 17. 1 .9- 

. ui»l 



- l)/n 



1 , 
(7)5. 1 - 
J 7 



COST MODELS PART B 



TIME TO PROFICIENCY (NOT COST) H 
n trainees 

_ week of training (100) 
1 {% complete) n trainees 
l-l 

n<3 

TPII - y (t8.l.)IOO 

{' ,(19.1.) n 
i«l 



TRAINEE TIME 12 

n trainees 

Trainee wage/hr „ trainee hours Instruction (time to proficiency) 

V , n trainees 

i"l 

n<3 

TT12 - WE2 ^ (22.I.(TPII) 
i-1 

INSTRUCTOR TIME 13 



7 instructors p -i 

I wages/for instructor i/hr j ( instructor hr/week) (time to proficiency) I 



. , no. of Instructors ; n trainees 

i«3 



"l7 

ITI3 « ) 25.i.(WEi) 



n<7 

1 25.1 



1-3 Li-3 
DELAYED ENTRY \k 



-I 

(23.)(TPn) 
n 



n trainees 

Trainee wages per day r days waiting to begin training 

n trainees 

n-3 

DEI^ - WE2(8) y" (21. i.) 
f«l 



41 

o 32 
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COST MODELS PART B (Cont.) 



RECORDS MANAGEMENT 15 
7 instructor 

r wages/(hr for instructor l/hr) 
^ ^ no: of instructors 

n<7 rn<7 "J -1 

RM15 - J 25.1. (WEi) P 25.1. (2^0 K 
1-3 L{-3 



(record keeping hrs/wk) (time to proficiency) 

n trainees 



TECH SCHOOL DELAY 16 

n trainees 
Trainee wage/day y trainee days delay 

, - n trainees 

n<3 

TSDI6 - WE3(8) ^ ilS^h) 



i-1 



n 



TECH SCHOOL EQUi VALENCY TIME 17 
n trainees 



n trainees f i r -i 

y (weeks to equivalency) (1 - percent capabi 1 i ty l trnee t ime * instructor t ime j 
n trainees [2 J [ weeks to proficiency 



"13 

TSE17 - r (29.i.)(1 -(.>7.l./10 0)) 
i»l 



TT12 + TT13 
TP 11 
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COST MODELS - PART C 



TRAINEE TtMr 2 1 

5 days 

Trainee waqe/hr r t rainee hrs/day (vjceks prof i ciency ) 

'. . number of trainees 

1 = 1 

n=5 

TT21 = WE2 V {31.i.){^.) 



PRODUCTiVE TIME 22 

5 days 

Trainee wage/hr y t rainee productive hrs/day (weeks to profi cienc y) 

n'l^'ber of trainees 



n=5 



PT22 » WE2 y (32. i.) jk. ) 

30, 

i = l 



INSTRUCTOR TIME 23 



n^7 5 days 

r y (wages for instructor i/hr) (i nstructor hrs/day) (weeks to prof ic Icncy) 
^ number of trainees 

1-3 j-r 

«T23 = Z v (WEt)33.i.J . (K) 
•-3 j., 30. 
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COST MODELS PART C (Cont.) 



TRAINEE TIME 24 



5 days 

nunber of trnees 



Trainee wage/hr j trainee hrs/day 



f-l 

n trainees 

r date AFSC - date entry - wks proficiency to avtard (7) 
ni^nber of trainees 



I 
7 



1 

n-5 rn<4 -] 

TT2i» - WE2 y 31.1. IT (17. 1 .8. -17- 1 .7. 1 17. 1 -9 - 0/n - (7)5. 1 

. 30. Lj-1 J 7 
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OUTPUT MODELS* 
MODEL 31, 32 - AVERAGE GRADE OF INSTRUCTOR 



n instructors 

r no. of instructors In grade \ (grade I) 
no. of instructors 



X. Y 
25.32 



n<7 

M(Y) - J" X.i.{f .) 
1-3 



n<7 

I X.i. 
I«3 



-1 



X - 14, 25 



MODEL 33-42 - AVERAGE CHARACTERISTIC OF TRAINEE 



OJT 


HI- 


X. 


Y 


X, 


Y 


2. 


33 


2. 


38 


3. 


34 


3, 


39 


4, 


35 


'I. 


40 


5. 


36 


5. 


41 


6, 


37 


6. 


42 



N trainees 

^ characteristic variable 

i-1 



total nianber of trainees 



N 



M(Y) - y17.i.X 
1«1 



I 



For OJT, For Tech School 



17.1.9. " 1.0 2< X<6 



MODEL 43.44 - AVERAGE TIME BETWEEN ENTRY AND AFSC 



OJT TTS 

I3 "55" 



N trainees 



I 




i»l 






N 


M(Y) 






L 




i-1 



date of AFSC - date of entry For OJT, For Tech School 
total number of trainees 



N 



MODEL 45 52 • AVERAGE ACTIVITY OF TRAINEE 

X, Y N trainees 

18.45 J activity 

19.46 1^1 number of trainees 
''0,47 N<3 

21.48 M{Y) - y X.I. 18<^X<22 

22.49 26<X<28 

26.50 '"1 
27.51 

28,52 



"The Output Models are used to compute certain intermediate results that were 
shown in Table 1, e.g., avarage grade of Instructor. 
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OUTPUT MODELS (Cont.) 



MODEL $3,5^ - INSTRUCTOR ACTIVITY/TRAINEE 



7*; 



23.53 



instructor act}vtty 
ntmber of trainees 



M(Y) 



n 



23.24 



MODEL 55,56 - ACTiVtTY PER WEEK 



X, Y 

31.55 

32.56 



5 days 

r actlvf ty/day 
^ n trainees 



M(Y) 



w 



X - 31.32 



X - 31,32 



MODEL 57 ^ 61 - ACTIVm PER WEEK 

Y_ 5 days 

33.3, 57 I actfvfty/day 

33.A, 58 1-1 

33.5, 59 

33.6, 60 M(Y) « r X.I. 
33-7, 61 f-1 



33.3 1 X < 33. 7 
33-3 1 X < 33.7 



MODEL 62 



INSTRUCTOR HOURS/TRAINEE 



7 Instructors 

1 

j"3 

n<7 
M(62) I 

j«3 



n trainees 



5 days 

J Instructor hrs/day 

l«l 
ml5 

I 33. J. I 
i-1 



30. 



o 
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OUTPUT MODELS (Cont.) 



HOPEl 63 - AVERAGE GRADC OF INSTRUCTOR 

7 Instructors 5 days 

y r instructor hrs/day (Instructor grade) 

7 , 7 , Instructor hrs " 

j-3 l-l 

n<7 rn<7 n>»5 1 -I 

M(63) - r I 33.J.ia) r Z 33.j.l 

j-3 1-1 |j-3 J 
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APPENDIX 5: SURVEY INSTRUMENT 



" 48 



AIR FORCE « 
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AIR FORCE SYSTEMS COMMAND 
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DEPARTMENT OP THE AIR FORCE 

AFNRL PERSONMEL RCSEARCN DIVISION 4AfSC> 
UCKLANO AIR FORCC BASC. TEXAS 7823S 



nfPLt TO 

•TTnof pESE (Capt Dunham/4106) 
swtiCGT 702X0 OJT Survey 




TO 702X0 Supervisors 

1. The purpose of Che attached survey is to collect data concerning 
On-che-Job Training to the 3-level in the Atfaainistration specialty. 
This survey data, along with infomation frra other sources, will be 
used in decisions concerning OJT and Technical Training School. 

2. Answering the survey questions with sotM thought and effort will 
aid Air Force decision oakers in the aanageaent of your AFSC. 

3. Peraission to conduct this survey was granted by Hq USAF/DPXOS, 
reference Air Force Personnel Test (AFPT) Nto^er 80-702-106. 



FOR THE CGMMANISR 





KOGCATT, (|^«ftel, USAF 
Chief, Personnel Research Division 



1 Atch 
Survey 
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INSTRUCTIONS TO 702X0 SUPERVISORS - 702X0 OJT SURVEY 

The accompanying survey is port of a rese<»-ch effort directed fowcrd evolu* 
oting the costs and benefits of **On rhe Job Training/* Your cooperation in compietin 
the survey is requested. While It will probably take only on hour of your time^ the 
tnformotion you provide will be very vgluoble to the research and will help to 
im^ove Air Fwce policies concerning OJT wid Technical Training School. 

if you do not quite understond o question, give the best answer you con ond 
feel free to write in on explanotory comment next to the question or on fhm bock of 
the form. If you ore completely uncertain about what a question means, enter o "?". 
If a question, for some reason, does not opply to your unit, enter **N.A." 

The survey is divided into tfvee parts: A, B, and C. Part A asks you to try to 
moke the best estimotes you con d>out your overage experience. Part B asks about 
what actually Happened to specific personnel lost week* Try to moke sure that you 
give answers for what really happened, even if it was not a representative week. If 
you feel that the week you reported on gives o bod picture of your operotlon, so 
indicate by writing in an appropriate COTment; and if you con, indicate whot the 
overoge value ought to be in your judgment. 

Part C asks you to keep a record of activities, eoch day for o week. It is 
importont thar you do this doily , so that what wcs octuolly done is fresh in everyone' 
mind. If you also feel that the week you repwted on Is not representative of your nor 
mol operations, so indicate by writing in ctj appropriote comment; and if you can, 
indicate a hot ^hc average volue ought to be in your judgment* 

If nvc- '".Mv cuostlooG, contoct Cnpt Dunhom, Autovon 473-4106. 

^ i.. i»i 



^ W 



SPKIAL INSTRUCTIONS 

1 • The trainee's supervisor should complete this suvey. ApproK- 
motety we (1) hour will be required to complete Pwts A otkI B. 

2. When onswering the questions, be sure to hove o ftoficiency Gutcte (STS) ^ 
and the Consolidoted Training Recwt< AF-623 for eoch persm undergoing troining, 
hcTKiy to refer io . 

3. The person who fills ovt this survey is encouraged to a&k for the help of others, 
such as the OJT AAonitor or an instructor when unc«^oin dbovt the cvuwer to a question. 

4« Ports A and B, which should be coi 'irieted Immediately, ore to be returned 
together with Port C within 8 days. Do n£L start Port C before completing Ports A & B. 

5. If there is difficulty In chiding whot Information is being asked for in any 
question, con toe t Copt Dunhon, Autovon 473-4106. 

BACKGROUND INFORMATION 

NAM E Job Title 

(Last, ^rst, middle initial) 



GRADE 



Social Purity Nwnb^ 
Base or Installation 



Organization 



Total Months at Present Base 



Total Months in Pr^ent Jc^ 
Duty Telephone Extension 
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PART A 

1 . What is th« total number of pers^nei in your Ac^inistration [ | | 

Section (officer, entisted, and civilian)? . 

' no. of pers. 

2. When a man (or womon) first orrives at your office directly from 
Basic Military Training, it may take i&ne time before he octually be- 
gins training and work, even though his "date of entry" to troinir^ 

may be the some as his reporting dote. This delay may be due to per- r— i 
sonnel processing, the need to wait for security ciewoice, or some | J } 

oHw cause. Apf»wimataly how mony <kiys does it take before the work doys 
r^ewty arrived "heip«'" Mfuaily begins OJT? 

3. There is also delay in entering trainlrtg cssociated with the crrival 

of a 3 level from Technical School* In c^diHiw to fMiscNwel iMocessing, <— |-— i 
fomiiorization with {»x>cedufes specific to your office may be necessary | | } • 
before Iw/she actually begins 5 level training. On tlw overage, this ^^|( ^Qy, 
delay is: 

4. Due to the "minimis time" requir^ent to ti^ 3 level, delays in 
paperwork, and delays in completing the Career Development Course, 
there is sometime a difference betwe^ time of award of the 3 level 

ond the octuol time the trainee takes to reach the required level of pro- [ [ [ 
ftclency in all skills necessary in your section. Based on your experience, 
whot is the overdue number of weeks it cKtuaily takes for a "helper" to >^o«ks 
reach the proficiency required for a 3 level In your sectlc^? 

5. On the overage, how many weeks elof^ between ochievonent of j | 
3 level proficiency end cctual awad of the 3 skill level? weeks 

6. How many troinem do you hove upgrcKling to the 3 and 5 level in | | | j 
your section? 3 jgy^j 5 i^^^j 

trolnees trainees 

7. In oddition to the trainees you now have responsibility for and ig- 

noring the limit on authorized number of personnel, how mgiy more 3 1 j 

level trainees could your office train right now without signiflcontly 3 level 
reducing the effectiven^ of sectim operatlcms? trainees 

8. If you hod to lose a qualified 5 level (70250) for each new 3 level 
trainee ("helper"), how mmy more 3 level trainees could your unit |~j 
train right now without signiflcontly reducing the effectiveness of ' 



section operations? 



3 level 
trolnees 



If you stopped doing OJT training could your section continue to | | j j 
Form its mission with fewer qualified personnel? 



9. 

perform ... . ... . 

How many less? 

□ 

53 personnel 



'^'^ &m mums 



4 



□ 

Yes 

□ 

OJT 



Port A (cont'd) 

10. If you lost your 3 level trainees, would you need additional personnel 

to do tKe productive work now being performed by the trainees? Yes 

1 1 . The newly orrtved Tech School-trained 3 level Is not as productive 
St first as the OJT-troined 3 ie/el Is, although he may soon close the 
gap. 

a. In you^ estimate, what percenter of the worklood of e.n OJT- 
troined 3 level con the Tech School graduc^ handle Immediately 
after his orrivol? 

b. How moiy weeks does it toke before the Tech Sehool-troined 3 
level works with as little supervision as on OJT-troined 3 level? 

c. After both types of 3 levels ore awcnded their 5 level, on the 
average cb you consider either to hove superior perfwmance? 

d. If your answer was "yes, " which type of 3 level do you consider to 
hove better perfofmcnce? 

12. If extra (remedial) training is conducted In your office for trainees who 
foil the End of Course Test (Apprentice Knowledge Test), answer the follow- 
ing questions: 

a. In your experience, what percent of the 3 level trainees fall the End 
of Course Test the first time they take it? 

b. On the overc^, how many weeks of additional training ore given to 
airmen who foil the End of Course test before they take the test ogoin? 

c. How many hours per week, excluding overtime, does the trainee spend 
engo^d in this remedial training? 

d. How many hours per week, excluding overtime, does the instrtfchor 
(trainer) ^end condMting this extra training? 

13. During the training period for 3 level OJT, the instructor (trainer) must 
spend some time keeping training records up to date. On the overage over the 
whole training period, how many hours (or fractions of hours) per %veek does the 
instructor (trainer) spend In record keeping for one trainee? 



□ 

No 



D 



Percent 

□ 

Weeks 

□ 

No 

□ 

Tech Schl. 



CD 

Perc^t 

□ 

Weeks 

m 

Hrs./wk. 

m 

Hrs./wk. 



Hrs./wk, 



14. Assuming th<rf your unit hod to train the sum of questions 7 and 8, 11^ the . — . j — . j — . 

number of instructors in each grode who would be responsible for 3 c»>d 5 level | | | | | | 

OJTs E-4 E-5 

□ □ 

E-6 E-7 

o 45 
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15. In this quesHon, you ere asked to provide estimates of training time ^>ent on 
various items in the Job Proficiency Guide (STS). The figures which you give will 
necess«-ily be average figures based on your experience. When you lock experi- 
ence or cannot recoil enough information to properly answer any port of this ques- 
tion, you ore enccuf-oged to consult with others in your office who would hove 
more recent experience or who hove been in closer contact with the training. Re- 
ferrol to a Job Proficiency Guide (or Specioity Training Standard) will help you 
give occurate infomfiotion . If you refer to the following items, you will see that 
training time *o 3 level proficiency for each skill is broken down into categories 
defined us follows; 

Weeks to 3 Level Proficiency ; The number of weeks It takes to reoch 3 level 
proficiency in thot skill. 

Troinee Hours per Week Reoding; This is the overage number <rf hours per 
week during the weeks spent becoming proficient in this skill that the trainee 
spends reading material relevant to this skill. 

Troinee Hours per Week OJT; During the time spent lewning this item, this 
is the number of hours per week the trainee spends learning the different as- 
pects of this skill, in addition to reading. 

Instructor Hours per Week; During the weeks spent by the trainee In learning 
this skill or knowledge, this is the number of hours per %veek spent by the in- 
$tructor(trainer)ln teaching (or lecturing)all trainees. This moy d.'ffer from 
"Trainee Hours per Week OJT*' in s«ne coses, such as typing. 

Troinaes per instructon This is the avero^e number of trainees hsidled by on 
instructor for a porticulcB- skill . This moy be the same for oil skills, «but not 
necessarily. 

As OP example, look at the first item, "Administration Career Field Progression," if 
the trainee receives work experience or training in this subject motter In your unit you 
would mark ''X''in the first column. We'll assume thot out of the weeks spmt by the 
"helper" in acquiring 3 level skill. In only one week we» there format training about 
"Administration Career Field Progression." So you would put a '1' next lo "Admini- 
stration Career Field Progression" under "Wf.-eks to Proficiency." This is not an ex- 
tensive subject, so probably not much time is spent on it. For the soke of on exam- 
ple, we'll soy that for the wlwie week the average trainee spencb one hwr reading oml 
receives two Iwuts of exploiotlcm cm the "Administration Coreer Field Progression." 
So you would put o under "Trainee Hours per Week Reading" and '2' under "Troin- 
ee^Hour; per Week OJT," We will also assume that the Instructor wos with the train- 
ee's) for their two hours of OJT and that he usually hondles two trainees while teach- 
ing the em. So you would put a '2' beside "Administrative CcH-eer Field Progression" 
under "I. ^tructor Hours per Week" and a '2* under "Troinees per Instructor," 
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?art A (cont'd) 

The Infofmotion for fhis item would lock like this: 

Receives Weeks Trainee Hours Trainee Hours Instructor Troirwes 

experience to week week Hours per 

In your unit Proficiency Reading OJT Week Instructor 

Administration , . _ _ 

Core«FI.ld g) QIl Oil IHIl □!] 0 

Progression 

Again, it is understood that these figures are not exact. Just give the best estimates you 
can e^out these average times. 

Receives Weeks Trainee Hours Troinee Hours instructor Trainees 

experience to p^ p» week Hrnos per per 

In your unit Proficiency Reading OJT Week Instructor 

AdministrotlcMi 
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Cweer Field 
Pr^fOttion 


□ 


1 1 1 


1 1 1 


1 1 1 


1 1 1 


□ 


Cmimuniccr 
tlons Securify 


□ 


m 


1 1 1 


1 1 ) 


1 I 1 


□ 


Supervision & 
Training 


□ 


1 1 1 


1 1 1 


1 1 ) 


1 1 1 


□ 


Ofttce rractic* 
es & Equipment 
Operation 


□ 


m 


1 1 1 


1 1 1 


1 I 1 


□ 


Publications 
MaiCQement 


□ 


1 1 1 


i 1 1 


1 1 1 


CD 


□ 


Reproduction 
& Forms Mc^- 
c^yement 


□ 


1 11 


LU 


1 1 1 


LU 


□ 


A<iministration 
Communico^ 
flt^$ Mctfiqge- 
mente 


□ 


1 1 1 


1 1 1 


1 1 1 


1 1 1 


□ 


Dm urn en to- 
tjon Monc^^e- 
mmt 


n 


LU 


1 1 ) 


1 1 1 


1 1 1 


□ 


* 

library Ser- 
vices 


□ 


m 


1 1 1 


LU 


1 1 1 


□ 


P^tdl & Couri- 
ei Services 


□ 


LU 




LU 


1 1 1 


□ 



PART A (cont'd) 



16. B<sed on your experience and, if you feel you need Kelp, the experience of 
other qualified personnel in your office, list the o^e^ number of productive 
non-p-oductive hours of work for the trainee upgrading to the 3 le^l for eoch week 
between stert of training and owo-d of skill level . For instwice, in the fourth week 
of training your frotr^ spent approximately ^ hours receiving instruction and reading 
and 10 hours doing productive work. Your second »itry would lode Uke thfss 

4 [M 

Nofe that fhe Kours for eoch week must sum to 40. 



Weeks of Training 
(to the 3*tevel^ 



Trainee Productive 
Hours per Week 



Instruction & Reodir^ 
He jrs Week 



1 


1 1 1 


1 1 1 


4 


1 1 1 


UJ 


8 


I 1 1 


m 


12 


m 


LU 


16 


m 


1 i 1 


20 


1 1 1 





17. For every 702X0 enlisted grade through E5 in your office for whom you have 
<n AF623 on file, provide the following inforniotion (if ovolldble): 

Dote 

Entered Oofe * Metlwd of 

3 skill AFSC Training 

AQE Score Educ, Training Award (Check one) 

Social Sec. Number Mech. A<fcnn. Gen, tioc^. Level Doy/Mrii DcQj/Mth QJT T.SchI 

cmm rrm mmmmmm mrrrn p □ 

rmm mii mmmmmi i ii ii 1 1 nn n 

rmm rrm LLii_iJLijmrncimTi.na n 



imcr 


" ■ 


1 


1 1 


xjrai 



□LnrnKiiDaa 
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PART B 

THE FOLLOWING QUESTIONS APPLY TO LAST WEEK ONLY. GIVE SEPARATE 
ANSWERS TO THE QUESTIONS FOR EACH INDIVIDUAL RECEIVING OJT TO THE 
3 LEVEL IN AFSC 702X0. KEEP THE ANSWERS FOR EACH PERSON IN A SINGLE 
COLUMN. 

(Individual) 
ABC 

18. Whot week of training Is each now in? [ j [ j j [ [ » | week 

19. What % of the 3 level proficiency train- |-^| — . |— j — j | — , — . ^ 
ing do you estimate each has completed? I I I I I j LJ i 

20. When they arrived at your office, what | | | i — | — | | — r-| ^ 
% of the duties of a 3 level in your section I — I — i i — 1 — I I I I 
could each c^piete? 

21 . If there was any delay in starting their « — j — i i — r— | i — r— i ^^^^ 
training, indicate how many days for I — I — I I — I — I I — I — I 

each. 

22. How many hours of instruction did each |— ^ — • p- 1 — i — p-i 
receive last week? I — i — I I — 1 I ^jLJ 

23. How many hours of Instructor time was i — r— i ^^^^ 
spent last week In training all of them? \ I I 

24. How many hours was spent last week in j j j ho^^n 
keeping training records for all of them? «— ' — • 

25. List the number of i istructors in each r— i | — i p-i r— i p-i 

grade who conducted OJT to the 3 level I — i I — It — I LJ I I 

last week for AFSC 702X0. E-3 E-4 E-5 E-6 E-7 



o 
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GO ON TO THE NEXT PAGE 
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PART B (cont'd) 

THE FOLLOWING QUESTIONS APPLY TO LAST WEEK ONLY. GIVE SEPARATE 
ANSWERS TO THE QUESTIONS FOR EACH INDIVIDUAL RECEIVING OJT TO THE 
5 LEVEL IN AFSC 702X0. KEEP THE ANSWERS FOR EACH PERSON IN A SINGLE 
COLUMN. 

(IrKii vidual ) 

26. If t^rs wos any cteloy in storting their training D 
to the 5 level becon^e of personnel preceding, . — | — 

familiarization with procedures, etc.. Indicate j L 

the number of work days of delay for each. 



E F 

mm*'/' 



27. The newly arrived Tech School trained 3 level 

may not be as productive at f i«t gb tlw OJT ,__ 

trained 3 level is, although he may soon close | ] | [ T"! | | I % 

the gap. What % of the woriclood of on OJT "^"^ L_L-J 
trained 3 level could each of the Tech School 
graduates hcmdie after their crrival? 

28. How mcny weeks after csrivol m station did 

It toke before the Tech School trained 3 level PI ] | | | 1 — j — | ^^^^ 
delivered performcnce equal fo that of m OJT — ' ' — *— • — • 
trained 3 level? 



YOU HAVE NOW COMPLETED PARTS A & B. 



PART C WILL REQUIRE YOUR KEEPING A RECORD FOR ONE WEEK O N A DAILY 
BASIS. 



PLEASE LOOK AT IT NOW. 
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PARTC 



FOR ONE WEEK PLEASE KEEP A RECORD AT THE END OF EACH DAY OF THE 
AMOUNT OF TIME SPENT IN EACH CATEGORY. 



29. DoTe started keeping recofds for Part C 

30. How many DO A airmen do you current 
hove in OJT fo the 3 level for AFSC 
702X0? 



Day 



Month 



Airmen 



31 . How mc^y totol liours did alt your 3 
level trairraes vi^ndi &n reading end 
receiving instn^ion each day? 



Mon 


TuM 


Wed 


Thur 


Frl 


1 










J 

— t- 




rn m 



32. How many fotd hours did ol! your 3 
level trainee spet^ in activities 
contributing to office productivity? 



33. How many total hours of instruction 
were provided by atxh grade of 
InsfTuctor? 



m m m m CD 
m m m m m 
m m m m □□ 
m m m m m 



□□mm 



AFTER YOU HAVE CCMPLETH) THE ENTRIES FOR FIVE DAYS RETURN 
THE SURVEY TO YOUR BASE CBPO. 



ERIC 
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APPENDIX 6: DISCUSSION OF THE COST MODELS 
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The cost of trainee time is a major cost element and 6 
different models were explored in estimating trainee time: 

• Model 1 uses question 15 for its source for the duraticm 
and Intensity of training time. Question 15 asks the resi>ondent to 
breakdown his estimates by 10 skill areas. It Is probably very difficult 
for the respondents to make these judgments because most of the 
estimates are relatively small , and because there Is no total to pro- 
vide a guideline for the overall effort. 

While this detailed Information may be of Interest In 
studying the nature of the training experlence« on balance* It Is 
probably not the best way to obtain cost data because of the relatively 
high coefficient of variation In the resultant riKKJel. 

• Model 2 utilizes question 16 for Its source of Intensity of 
effort and question 17 for Its source of duration. Question I? Is 
generated by the respondent from written recordSy and Is probably the 
best source of duration data. However , question 16 over-estimates the 
Intensity of effort, because many respondents misinterpreted the 
instructions and did not conplete their entries In the later weeks, 
where training effort would have been reduced. This nK>del» therefore, 
contains a definite bias on the high side for this set of survey data. 

• Model 3 uses question 16 and contains the saro bias as Model 
2. It also uses question k to estimate duration, which has a partially 
counteracting bias on the low side. With sources of known bias it 
Is a very poor model. 

• Model 12 has a very high coefficient of variation because It 
Is based on questions 18 and I9f which. In turn, have high variance. 
There is also possible bias because sme respondents misinterpreted 

Lhe relationship between question 19 and 20. 

• Model 21 was based on question k which has a very significant 
low-side bias. 

• Model 2k is the best of the training time im>de1s since Its 
sources of duration and Intensity data, questions 17 and 31, are the 
best estimates of these parameters. In the future the Uniform Airman 
Record should be utilized to provide the duration data In order to 
generate larger sample sizes, and reduce questionnaire complexity. 

Three models were explored for estimating the cost of 
instructor time : 

• Model k has the sample problems as trainee time Model 1. 
That is, It is based on question 15- It has low-side bias and a high 
coefficient of variation. 
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• Model 13 also has a high coefficient of variation, and the 
same possible biases in respondent misinterpretation discussed in 
Model 12. 

• Model 23 has the minimum coefficient of variation of the 
three models and no suspected biases. Like Model 2k It Is based on 
Question 17 (a written record, for duration Information), It utilizes 
question 33 for intensity information which provides an actual v^lght- 
ing of hours and grade; and it has a low coefficient of variation for 
the estimate of hours per trainee. 



Two n»dcls were Investigated for estimating the cost of 
delayed entry to training: 

• Model 6 is more efficient than Model l^i; that Is, It has a 

lower coefficient of variation. Both are very simple models, but 6 was 
based on a single answer to Question 2, whereas 1^ was based on the 
more complex response to Question 21. 



Two models were also inves-t igated for estimating the cost 
of records management time . 

• Model 15 has a slightly lower coefficient of variation than 

Model 5. Both models have some hJnh-slde bias because of responses to 
questions 13 and 2^, although the absolute amounts are small. 



Two nwdels were also Investigated for Tech School Equivalency 
and Tech School Delay costs, respectively. 

• Model 9 was judged superior to Model 16 for the same reasons 
Model 6 was judged superior to Model l^; I.e., Inherent simplicity and 
lower variability in response. 

• Model 8 was judged better than Model 17 because Model 17 had 
a very high coefficient of variation. Model 8 also ^nploys the better 
estimates of resource utilization (Models 23 and 2k) as Inputs, and 
would, on those grounds, also be more acceptable. 



Only one model was used to estimate Remedial Training Time 
cost : 

• Model 7 is very small In absolute value. It was based on the 

response to question 12 which was the only question used to collect the 
basic inputs. 
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APPENDIX 7: SELECTION OF AN OPTIMAL OJT/TTS MIX 
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Due to the develofvnental nature of OJT costing research, much 
of this report is devoted to a discussion of different aspects of the 
costing methodologies. However, for purposes of OJT and TTS comparisons, 
factors In addition to OJT costs need to be considered as criteria for the 
select!^ of an optima) OJT/TTS mix. Conwnents from several sources 
indicate that the importance of these other criteria needs more emphasis 
to place the cost comparison in proper perspective. This APPENDIX 
expands upon points made in the basic study to anphasize the limitations 
of dollar cost estimates of OJT and TTS as the sole criterion In estab- 
lishing the number of non-prior service airn«n sent to resident TTS and 
the number sent DDA, i.e., OJT. 



As indicated above and in an earlier report (Dunham, 1972), 
the cost of OJT Is substantially less than TTS costs for AFSC's 291X0, 
Communication Center Operations Specialist and 702X0, Administrative 
Specialist for training to the 3-level. A conclusion, which might be 
Inferred from a cursory examination of these costs is that the Air Force 
sh<Mld send as many men as possible to OJT in these specialties. 
However, as explained previously, (Dunham, 1972, p. 9): 

••...the results are not Justification for discontinuing 
the technical school course for Comunicat ions Cent *r 
Operations. The data do suggest tH&t the Air Force 
should send as many personnel as possible to OJT in 
this particular skill, although the exact number or 
percentage of the training requirement who should 
upgrade through OJT Is not specified. 

There are five criteria relevant to dntermining 
an optimal mix of OJT and technical school training 
In any Air Force specialty: 

1. Cost of technical school training 

2. Cost of on-the-job training 
3' Quality of training methods 

4. Capacity of training methods 

5. Personnel assigranent system constraints" 

The OJT/TTS mix may affect the quality of trained airmen, 
the time necessary to meet a sudden increase in required operational 
capability, and the ability of units to maintain their (^rational 
effectiveness. Also, there are a number of non-quantifiable factors 
which include inad^uate neasures of productivity. The ^portunity or 
alternative cost of any training Is the value of the productivity lost 
(if &ny) as a consequence of conducting the training. Unfortunately, we 
have only crude methods of determining productivity and for estimating 
its value. Quite often, the Air Force and irost other public organizations 
back up a step in the production process and assume that the value of 
output must be at least as valuable as the sum of the cost of the inputs 
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used in the production process. Hourly wages of instructors and trainees 
are interpreted as '^morginal value products." It is assumed that the Air 
Force competes for airn^n with private industry, and other governmental 
agencies, and that no elenents of monopsony exist in the marketplace. 
High school graduates are attracted to the employer offering the highest 
benefits. A zero-draft environment Is also assumed. Thus, to measure 
training cost (I.e., the dollar value of lost productivity), it Is usual 
to determine the tifl« spent by instructors and trainees in training and 
assume that the value of this time is the corresponding dollar wages. 
For TTS this time is ^0 hours per weetc; for OJT, something less than kO 
hours per we^k. 

This 'productivity lost' cost coiKept Is ns»t new, but It is 
rercly explicitly mentioned. Another implicit assumption often used is 
that training costs are linear with respect to training load. At face 
value, this assunption appears reasonable, particularly with respect to 
TTS. In TTS, there is often a constant relationship between the number 
of Instructors and the number of trainees, e.g., for every additional 
twenty to twenty-five trainees, one Instructur is added. This step- 
function is approximated by a llneai relationship, when combined with 
trainee time. However, if an instructor is sent to TTS to Increase the 
number of TTS graduates, this means that a potentially productive MCO 
is not at an operational unit, thus resulting in at least a temporary 
diminished productivity at the losing unit. 

At times, this is not much of a burden, but the Trained 
Personnel Requirement (TPR) could easily double or triple without a 
corresponding change in manning.^ Under thase circwnstances, trainer 
manpower requirement could be inordinately large and cause a strain on 
the ability of units to maintain the necessary level of productivity 
or mission accc^pl ishments. 

Wages (input costs) are not representative of training 
costs (productivity losses) under these c!rci«nstances. To put it 
another way, the assumed linear relationship between training load and 
training costs Is not linear when training loads Increase rapidly. 

The above argument also applies to cost estimates of OJT. 
Beyond a certain training load, the cost estimates based on wages are 
underestimates of the productivity loss associated with adding one more 
trainee. In fact, because of the lovt«r student/ instructor ratio feasi- 
ble for OJT, the relative cost relationships reported for OJT and TTS 
may reverse under adverse training loads. Manning In the field frequently 
does not increase with the on-the-job training load. Small operational 



WPR's are very sensitive to variables largely uncontrollable by ATC, 
e.g., budget cuts, mission changes, and new *»«apon systems. 



units can only h^ve so many of their qualified 5* levels replaced by DDA 
'helpers* before unacceptable productivity losses result. When manning 
requirements increase rapidly, the 20 or 25 to I student/Instructor 
ratio at TTS could make TTS the lower cost method of training. 

The current state-of-the-art of prcxiucttvlty measur«nent 
does not allow this situation to be incorporated Into the cost estimating 
procedures for TTS and OJT, but there Is an alternative method of dealing 
with thf> problem. 



it has been argued that at some maximum training load the 
cost advantage for OJT may disappear. Instead of speaking In terms of 
total training load, we could obtain estimates of the capacity for OJT 
at given manning levels. Capacity for OJT Is defined as the maximum 
nifliiber of {^rsonnel who can be in OJT at any point in time wittout 
causing "unacceptable"lo5ses in productivity. 

OJT capacities need to be obtained for each AFSC under study 
and could be used to conpute upper limits on the number of DDA's who 
should be sent into the field during any specific time period. 
Methodologies for estimating OJT capacities need to be developed. The 
estimation problon is cc»nplex, but solvable. 

The training capacity problem was Identified In the original 
development of an OJT costing methodology (Dunham, 1972). A minor 
objective of the 291X0 OJT Survey was to collect OJT capacity data for 
AFSC 291x0, Communications Center Operations Specialty. Responses to 
question 9 of the 291X0 survey— 

"9. If you had to lose a qualified 5-level for each 
new 3* level trainee (helper) how many rrore 3-level 
trainees could your C<xm Center train r'tght ncH* 
without significantly reducing the effectiveness of 
the Telecorm operations? ^3-level trainees" 



wer2 combined with Uniform Airman Record data to obtain a rough estimate 
of the capacity for 3" and 5-level OJT for AFSC 291X0 of 15^8. In other 
words, given the inanning standards at the time of the survey (tor 1970), 
the maximum number of personnel who could be upgrading to the 3- and 
5-level through OJT at any one point in time for AFSC 291X0 was 
estimated to be 15^8. 

This capacity estimate has some shortconings, but it was 
probably a conservative 'ballpark' estimate for the AFSC. Sending 
enough personnel DDA to exceed this figure would. In the minds of the 
supervisors v/ho responded to the survey, "significantly reduce the 
effectiveness of Telecomm operations." 
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From the time of the "291X0 OJT Survey" to the beginning of 
FY 1973, the manning as expressed by the number of personnel serving in 
Duty AFSC 291X0 has decreased approximately 2^*% In CONUS. ^ Since one 
would expect OJT capacity to vary with manning, a revised caparicy 
estimated would be lt73« 

It would be useful to present an example using the above 
capacity estimate. Table 3 shows the actual number of ODA's and TTS 
entries sent from the School of Hllltary Sciences— A irmen^ at Uckland 
AFB during FY 7Z tro^ these allocations compare against the 'ballpark' 
OJT capacity estimate of 1173. 'n November 1972, the nwnber of personnel 
participating In 3- and 5-level OJT In CONUS Is 97% of capacity. The 
months following November continue to show near-capacity numbers of 
personnel in OJT, finally exceeding the limit in April 1973. 

It 'hese people in OJT to the 3" and 5-level were allocated 
to the units in a manner designed to minize their detrimental effect 
on productivity, and If the assumptions for Table 3 (Footnote ^ jf that 
table) hold, the Air Force has satisfied the estimated capacity 
constraint for most of CY 73. Violation of any of these 'lfs| would 
probably result In significant productivity losses at the unit level. 

Some of the assumptions behind Table 3 are quite tenuous: 
that is, the capacity estimate is, at b^st, a rough estimate; more of 
the TTS graduates may have been assigned in CONUS than the assumed 
59.8'/^ of the monthly assignments; satie commanders or units may have 
received a disproportionate percentage of the ODA's. 

A simple dollar cost comparison, as pointed out above, does 
not encompass all of the important criteria. This APPENDIX has discussed 
only briefly one probl&n which would occur If the dollar cost compari- 
sons were taken as the only facet of the problem, it Is likely that the 
problem presented can be solved through development of Improved capacity 
estimates cwiblned with improved unit asslgrwent methwis. 

This APPENDIX Is not an exhaustive discussion of the 
"capacity problem," nor Is training capacity the only criteria not 
quantifiable Into dollar costs. Selection of optimal OJT/TTS mixes 
requires consideration of criteria which have not been mentioned 



kONUS manning was used for the original estimate because non-prior 
service DDA's generally cannot be sent overseas. 

^Basic training. 

^Obtained from Dec 72 UAR, expresses percentage of total OAFSC in 
CONUS. 
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Table 3 

Nunber of 3" and 5-Level Trainees and OJT Capacity^ 



Month 

July, 1972 

Augus t 

September 

October 

November 

December 

January, 1973 

February 

March 

Apr!! 

May 

June 



FY 1973 

Total Ni^ber of Trainees 
in 3- and 5-Level OJT 

597 

613 

633 

903 
11^2 
])k3 
1105 
1065 
115^ 
1225 
Not Available 
Not Available 



Difference Front 
OJT Capacity 

(+)576 
(+)560 
(+)540 
(♦)270 
(+) 31 
(+) 30 
(+) 68 
(+)108 
(+) 19 
(-) 52 



*TTS entries and DDA's obtained from ATC P-68, "Disposition Report of 
Graduate Airmen Receivlr^ Assignments." 

^Assumes (1) ODA time-to-upgrade to the 5- level Is 1^ months, while TTS 
time-to-up^rade to the 5" level is 12 months, and (2) up to kO.2% of the 
TTS graduates are assig^'^d overseas. Time-to-upgrade information was 
obtained from CY 1970 data, but should serve for illustrative purposes. 
More current time-to-upgrade data are now being collected by AFHRL. 



here or elsewhere in print- A subsequent TR Is In prepardtlcHi 

at Manpower and Personnel Systems Dlvisiont AFHRL which will go Into 

more detail on a methodology for selecting optimal OJT/TTS mixes 

It was the purpose of this APPENDIX to demonstrate the 
need for n«re information than just OJT and TTS costs. While costs have 
an important role, ignoring other criteria could result in a mlsalloca-' 
tion of resources and subsequent r ea) losses in productivity and Air 
Force mission accomplishment. 
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